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J~ t has been almost four 
years six\g^ A Nation at HM 
united grgwing dissaUsfaaion 
witfi eduottion in America into 
ail educaUa*lal reform movement. Tlie 
thirty or more riByor reform reports 
a^t have appeared since are in solid 
agreement that edUcatibri in the public 
schools and in collies and universi- 
ti^ fells short df "eccellehre.'' 

Su^estions far reform in higher 
eduation have much in common with 
those for dem^ffiMy/secondary educa- 
tion, but there are also s^ interest- 
ing differences, R^rm in the public 
schools seem to center around tfie 
qudity of teadiing and the quality of 
the workplace, to colleges and uni- 
yersiUes, the en^tesis is more oh cur- 
riculum than insmictipni l e, on uiMl 
is tiu^t more tf^ or tow it Is taught 

sdicols arid colieges havie in 
OMimcvi in i^ 1960's r^nns is tFuit 



in lx>th cases^^ the reports look beyond 
the classroorn teacher for aoion. Tlie 
advocates of reform in the secondary 
scSqols place respDnsibility for 
improvement oh th(»e ^o train, 
^ject, and supervise teachers. In 
higher educationj the responsibility for 
eduatibnal reform is in tfie hands of 
cuiricujum committees and the cbllec- 
ti\^ faculty ^o are uiged to take 
action to incrt^ise requirements and 
raise standards. Sd far, there has been 
Httle discussion in eitfier ^cpndary or 
pbstsecbndary edueatibh about \^t 
individuaj teachers shbuld be doing to 
improve le^ing in their own class- 
rcKinxs. ^lile we taft easily bf tc^diirig 
and iramingi we 2f^j^&d[\y 
uncomfortable talking about t^chihg 
ybr Jeam I Ulihk we need to b^iri 
to talk boldly about wiiat teachers can 
do to dai^ l^tming. 



a 



Icsming, we arc g^- 
talkhg about tcs^- 



JTrom research conducted over the 
past several decades, we know some 
useful things about how to promote 
^dent learning. I have distilled the 
findings from this research into three 
major conclusions that can be stated 
quite simply. For all the r^earch that 
has gone into ^tabUshihgtheie cbn- 
ciasions, the\' sound embarrassingly 
obvious, yet they are frequently 
ignored in school and college 
classrooms. 

1 . WHEN STL'DFXrS ARE ACnVELY 
INVOLX'ED IN THE LEARNING TASK, 
THE1' LEARN MORE THAN WHEN THEY 
ARE I^SIX'E EECIPIENTS OF JNSTRtie- 
tlON. Nothing ver>' stiiprising Jn that. 
But research shows thai dassrooms 
\'ai y enormously in the way time is 
used In some classrooms, students 
are actively engaged in learning 90 
percent of the time; in others, the>' 
m/y be ihTOlved drily 30 |x rcent of 
the tirrie. Clearly, some lesidiicg 
m eihods i^r rnore likely id Qi^e 
students than others. After hundreds 
of studies comparing ieciures with 
dlscussioas, for exampie, we find the 
discussion method somewhat supe- 
ribr lb lecture in e?g]erimenLs irivdlv- 
irig retention, transfer of irifoririaiiori 
i() niSiV situaUons, problern .s(^^ 
tliinkihg, anirude change, and mcxiva- 
tion for farther learning (McKeaSie, 
ei. ai., IS^). These are important out- 
a)mes, supplying the call for more 
dLscUssi()n arid fewer lectures. But tile 
measured diflererices between lec- 
ture arid dLscussii)ri are riot large^ 
pnixibly because ^dent 
mtSii Ls a jnt^re itnportmit variable 
than metlKxj of instruction. An excel- 
ient ieciure nm get exceiieni invukt;- 
iiieiit, wliije a poor one ma\' 
iXMle. A llN'eK' discussion itl^' ei^g^ge 



ev^ryoffi^a w,iridering one^ \vry 
f^. Tlie Svolvemari demanded by 
teadiiit^ metj sadh as_ra, Mas^ 
lery Learning, case smdy, and interac- 
tive coniputer prqp^ams is Jjkeiy to 
be quiwj high, but invoK'ernent alone 
will flKS result m prddua'\'e grcmth. 
That lea^ to a secorid ri>ajor research 
cbncli^ibri. 

2. SllJDENTS GENER'^^^ 
THEY PRACTICE. If they practice mak- 
ing oxbrs in skills courses or sloppy 
thic&&^ jnjdisctissioru tlien thari^ 
what ihcy Jeam: If teachers nstques- 
tioas in dass or on teas, oiling for 
iittje more than memorization of 
facts, iten that is ^im studenLs t^ill 
learn, ff there is rib feedback bri per- 
forrriarice, students can go an entire 
saT>«iS without mudi intiicailon of 
%iidfiet their Jeaming is^ productive^ 
nonproductive, or counierproduaive: 
A rebtiveiy new research x-ariable, 
iateied "acadesriic leaning time" or 
ALT, B defined as time engaged in 
learning related tb desired ouicbmes, 
during which a studerii experierices a 
high succ^s rate (Berliner, l9i4). We 
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can state it rather simply: stiideriLs 
rieed lb be actively m&^4(X/&^fy 
irivblved in l^imirig tasks that lead to 
deiired ouieorh<^. Nothing at all sur- 
prisiqg about that; "What is surprising, 
peitiaFS, is how fi-equently rKOTch 
demonstrates that Academic Learning 
Time shows endrmdUs variation frdm 
teacher to teacher. 

I have riot beeri able to locate stud- 
io at the fK^tsecbridary level that 
have attempted jo m^sure MiT,_but 
profeisors could make a roo^ S^uge 
of their own use of it by asking them- 
selves tvc'd que^idas. TTie first is, how 
closely related ixe the leanlirig tasks I 
assign to the: learriirig biitcbriies I : 
d^ire? If a d^ired ouicbriie is inde- 
pendent thinking, and the Idling 
tiKks are ihformationalTeading 
assignments and note-taidng during 
lectures, then the ALT will be quite 
low. 

The second qiiestidn is, how 
clbsely related are the test questions I 
use lb the buicdmes I desire? If a 
d^irod outcome is the ability to com- 
munidite cl^rly, ^d ihe t^ consists 
of muliiple-dioioe and true/£aise 
questions, then students are not likely 
to practice successfally what the 
leadier Tv-ants them to leani, and ALT 
once ^airi will be cjuite Ibw. 

3 JF TEACHERS SET HI_GH JUT 
ATTAINABIX GOALS, ACADEMK: PER^ 
FORMANCE USUALLY RISES TO MEET _ 
EXPECH'ATIONS This has been labeled 
the "Pygmalion effea," and there is 
raasiderable evidence df its c^ra- 
tiori in bcxh seomdan* arid pbstsec- 
oridar>' ediicaiibri. Richardsbri arid his 
coUoigu^ (19835 found. In their 
o&en^iion of mll^ classrooms, 
that there is sometimes artunj^ken 
agreement between leidier and stu- 
dents that neither will make very 
heavy demands on the other. Thus 
teadieri; ddri'i wbric vety hard at 
teactiirig, arid students don't work 
verv' hard at learhirig. It is a reasbna- 
hle gueis that neither shows riiiidi 
^^sffi Cff lrnpiXACTienL Miariii-ESade 
Gcinmimiiy eoll^ found that wlieri 
ihej' raised o^e^fions, in a move 



aiirenr mthuswstn 
jbr ^^^tient^ it 
lootfs as dioi^ it 
will ...do little to 
impivve the quality 
(^lemiii^bi tiie 
avaiage ck^rocm. 



that some criticized as racLsi, student 
peHbmance ipse id meet the new 
standards (McQtoe, ri.d.). 

There is hd argument in the 
r^eurh cbramuhity ihaj ih^ con- 
cluisions flffe^igifficarit Sdbfs in ati- 
dent learning— nor, I suspect^jloes 
any teacher question their relevance. 
Yet researchers corisi^entJj' find that 
such comitrori sense practices do not 
exist in many cblte^ classrdCMtis. The 
authors of the 1984 NIE Report, 

that "undergraduate educ^don could 
be significantly improved" if we sim- 
piy appiied what we already Icnow. 



f ow 1 want to lumio assessment 
propc^als. We in hi^er education 
are putting a lot of i^th in ass^ment 
as the route to atmining quality in 
urideigraduaie educ^bn. Aoxirding 
Id a recent: Qanjj^My Trends report 
L^ued b> the American CbiJiol bh 
Education (El JSia^, 1®6), ihree- 
fourths of all ralfcge adSirtiaratbs 
think that assesment is a good idea 
vi+iose time has come. More interst- 
ing, hoviwer, is the finding that 91 
percent cf college admini^ratdrs 
think iliai asse^rneni shbuld be 
linked to ihstructiohal improvement 
Mc« authorities agr^. Turnbull 

p 25) diiea^Si " 
nSngpurpose of gmhering da^ _is to 
provide a basts for improving instruc- 
tion, nithCT than k^ing score or 
aliocating blame." The Edix^K)n 
Cdmrnlssi()h of the Slates' 1986 
repbrt asse^^ that * A^selsmCT : 
shduld not be ari end in itself. RatHei- 
it should be an int(^ral part of an : 
insittttkm'&sraif^' lb fiiprove i^di- 
ii% and leamtr^ . . .** 



But in most colleges and in most 
stales, we have yet to forge the neces- 
«iry links between a*lse&smeht and 
irtWJCtibn. So Ear, classrpbrhs con- 
tinue to be i^irded as the rnystery 
boxes of education. we really 
want to know iSr Vt'ta are_^dv*nts_ 
jeoming in clajsrooms and jaborato- 
ries and anyplace else we are con- 
sciously siri\ing tb teadi them? Yet 
what we are prbpbsirg lb do is tb 
bypass the classrbbrn and ^ rlirecly 
to i^e^eht— lisually i2i{^ scale 
asessments taking place at ihstitu- 
tionaior statewide levels: _ 

Unfortunately, this approach to 
assessment is not going to tell teach- 
ers much about vAvax students are 
learning in their cla&srbbms, arid 
therefore, it is nci gbiiig to be ver>' 
belpfiil to them. SiriS bur classrbdrn- 
based ^stern bf ediicatibri is orga- 
nized and fonded on the assumption 
that something important happens 
when teachers meet students in the 
da^rbbm, :eichers are going to ha\'e 
to get better inforrriatioh from assisss^ 
ment if we Expect to irhprpv^e the 
qualiSvbf undergraduite eduouibn. 

A few colleg^; sndi ii^vernb, 
with extensive experience and heaxy 
&cuit>' involvement in ais^ewment, 
have managed to make a profound 
impact bh teaching. But moM cbj- 
le^, I predict,:WilJ conduct their 
asse«merii, add a fe>\' rhbre course 
requironaits, y^teh acadOT stan- 
dards, and see that ^denis toe the 
Ime: D^ite all of ffie current enthu- 
.siasm for assessment, it looks as 
though it wiii .<aop short tif the class- 
room dcxjr, doing little to impfoVTe 
the quaiitj' ci learning in the a\'erage 
classrbbrh. 

li is for diLs nason that I prbp(^ied 
at lis y^ear s AAHE National Confer- 
ence the devek^^ment trf a ne5^* s^ of 
.*ilts and tcx)Ls for college i«idiers 
that 1 ciiied "Classrcxjm Researdi." 
The purpose of Classfoom Researrfi 
Is lb help teachers ex'aluaie the effec- 
tiwless of their own jeadiing. 

Md^ieachers reayily d()ri i kho^' 
how efiective the\' ai^ as toRiiers. 
d^srocm R^earcH giv^ than ^ 



quicker and better feedbadc on what 
studenis are ieiming and how they 
are r<2^nding lb teadling. A second 
goal bf Classrbbrn Research is lb get 
teachers ihiellectually involved wtth 
the challenge of t^diihg by helping 
them cliflfy what th^Lare irjhng to 
do, and assess the impact of their 
Inching on student performance. 

TTie probiem with earlier efforts to 
get teadlers to stmeteadling objec- 
tives u'as that goals becsme the serv- 
ant of rneasurernOTi rather tharl vice 
versa. Behavioral bbja:xiv^ became 
downright silfy beiause theiask Twas 
to state, as a leadiing objective,'" what- 
ever we couid mosure. It serv« no 
asefuj purpcse to kjwer our edua- 
tibnal aspiratibris because we cannot 
yet riieasure ^^iat we think is irnpbr- 
tar^t to leadi. Quite the contrary, rtiea- 
surernetit arid ass^rrieni will have to 
rise ibJie challS^ of otir aluca- 
tional aspirations: i am nbt confident 
that is the case in most of the current 
plans for assessment. 



X eavirig aside the dLscussioh about 
^xals, let us ask qu^ibn. What 
are?0cioB0s:ii}1rig to dQ^^rohjcaU 
that is one of the least researdied 
questions in hi^ier education: We 
rar eiy ask teachers what they hope 
students t^lji iearn frbm them. Most 
«jrve>'s directed tb £aculty anempi to 
describe their relatively uhsiliCTable 
diaradeii^ics^ A natjohal study con- 
ducted in 1973 MS pilriiSrily cbrv 
cemed ^itli Eaculiy diaraoenstics, hut 
Alan Bayer also incbded some ques- 
tions ^x>ut t^chirig goals. He found 
that 97 percent dT the teadlers in 
ammuhitx' colleges, fbur-year col- 
1<^^^ arid uhiversiUes thought that 
deveP^irig students' abilities to think 
cl^ly uus "evseniial" or "vct>' 
important" in thdr lodiingof tLiler- 
graduates: Almost as nmy ^CHi^Eit 
ihat mastery irfkno^'jedge in a disd- 
piine and incn^ng the desire and 
abiiitj' to undertake self-directed 
ieaming wrc inq^brtam (92 |S?rcent 
and 89 percent, na^^iiiiel)'). K 
wuuld be inter^tii^ lb know what 



f ^ diat we 



dont use to 
he^ teacf^rs as weU 
as tv t^Iuate Oi&n, 
and iVs doubly 
timt we don 't tiam 
^mjd&its to be care- 
Ail obs&v&s ofthar 
own 



teadiers did in their classrooms to 
prepare students for self-direaed 
leaitu^g, of how the 47 percent sul> 
scribiiig to the dewejcpmdii of moral 
(^iaracter or the 57 percent endorsing 
the JMdijev^OTi of cfe^ 
sdid^ts'^tf-urid^sbmdirig^^^t 
about implementing tlx)se goals: 

The theme of this conference is 
*T^king Teadi»ng Seriously." I, for 
one, would like to know how college 
teachers think about ^derit learnir^. 
To dtat end, I am developing a Teach- 
ing Goals inventory (TG13* iL asks 
leiehers td select one and state 
die imporctnce of various teiching 
gosds for that class. We are currently 
in the process of pilDi te^g an 
ijlvenloff' consi^g of 48 items dis^ 
tilled from the literature oh ccgriitive 
and afil[6!Ctive ^sals ahd oufcbm^ of 
hi^^i «luC5Uldh. The cdJUeetioh of 
dam^ dii teaching^ goads raises some 
hit^^ting^ research questions— for 
example, do tochers in commtinity 
<X)lleges e^x>u5e different goals from 
those in liberal a^ collides or Urii- 
v^iUes? Do teachers in physics have 
difiereht gcals from those in history? 
Dd the teidiing g^aLs of e^rieacfid 
teadieis dffierfem these xiinexpe- 
rienced teichers? Do pm^ime and 
ftjll-time tadiers hEjve different 
goals? How do the accumulated gcxils 
of ciawddm teachers relate td ir. Utu- 
Udhal gdaLs? Collectively, facultj' serv- 



*?^pfeciaii6n is a^^esxd to Elizalxtb 
Fideier a gn^ion^ stiJdem at ^ ~ 
siirci Gradisme Scbool Gf Ednceuioti uix> 
^^Wt^Ms^nseMidb ass^imtt m ihe det^T' 



ihg oh <^iculum cdmitiitiees are 
quite likely to ehdorse^arxl sdme- 
lirrw^ prdmise— the devefopmoit of 
seff-ander^mdiQg^ dr iridiaL dwac- 
ten Preliminary evidence from^the 
TGI indicate that at one coOege no 
tocher i^d moral development was 
an impditant gcol of h is of hef teadi - 
ing. How theh does it bedme a goal 
dfthecdll^? 

Th^ are interring qiieiidhs, 
iid we will pujsue somejcf them, _ 
but my n^r intccot in developing 
the TCI is to provide t^chets with a 
profile of theif imtfuctiorol priorities. 
Once w determine the rna|or clus- 
ters or factors of teadiihg goals, w'e 
can devLse a set of ass^mait mea- 
suPK that will tell teich^ wheth^ 
^d^ts are laming wi^ t^d>ers 
siy they are tiding to teach. That will 
take the form of a set of feedbadc 
devices indexed to teaching goals.*** 

Feedback deviqss are iddls tliat tell 
teachers how studehts are respdhdii^ 
to their t&ichihg. If, for exarnple, a 
tocher st2^th^ masiei^* sub^ 
iratt^is ail e^smial^dzicf his^o 
her teidiing, ^en the traditional 
classroom test is a fairly good feed- 
bade device. Almos every leaKtter is 
ihteresied in cbhteht leaning to 
SDme extent, arid we (those of us in 
the prdt^idh of education) kno^' a 
fair amcHiht :^uthd^?^td construct 
t^s tliat are reliable aiicl A'adid^ low- 
ever, most college trachers Imow 
almost ncxhing aix)ut corsmicting 
classit)om te^. The]^' u^ vm* primi- 
tive measures becallse thej' ha\'e 
never: been exposed to existir^ 
khdwle^^ about how to cdnstruci a 
t^ tt^ will prc^de rna^&ii^ ihfdr- 
maticxiibotu ?iidentJe:OTir^ tests 
are frequently used simph; to .son 
and gt^de students. 

Tte c«her problem with cbLWtiom 
teas Ls that thej' are ffequerih-^;/a7 



ofjpe Vnuvraty ofAru^^^We H^- 
lord AsssS9tm7tSeniifiarfor fiituiittg, 
mid to T^dm Mtj^To, ^raduMe sttuTimi at 
vito served as iwseimifiEs^mjt. 



exahis^ and feedback comes too late 
td irhp>rdve teachihg for that class. 
Sdrae tiKichers, however, liave 
devbed-effective ways to find out 
what they need to know about stu- 
dent r^cUons z&Mng the seme^ef . A 
piiysics professor at the University of 
Caltfofriia uses the extfertiely sirhplle 
device of "minute psp^ere" to obtain 
student fe^Jbadk oh classroom learn- 
ing. He stcf^cl^dhe minute esfly 
fourir fiw* times during the term 
and asic students to write the 
answers to two quesUons: 1) What is 
the most signifiduit thing ydU learned 
today? arid 2) What question is lippier- 
rhdst in your rhihd at the ehd df this 
class s^idh? ihfe gtvcs film excellent 
feedback on wh«her students are 
understanding and wtiether there aie 
important questions to which he 
should respond (Wilson, 1986, p. 
199). : 

Aipihef frequently used feedback 
device is studeht evaluatidh df teidi- 
ers and couis^. In two-thirds of the 
fcur-^^ libeS its odII^k, aa- 
demic defflTS daim that systematic stu- 
dent ratings of instruoion are '^alw^'s 
used" in the ex'aiuation of feculiy (Sel- 
din, 19S4). Yet teadiers claim that 
the>' do riot firid student ratings, col- 
lected for pUrpcses of ev'aluatidh, 
specially hSpful in improving teach- 
ing. That s perhaps uhderstandSle, 
but it s too bad 



t5tudents are a rich and virtually 
Uritaj^Ssd resource ;bf the impro\»e- 
merit of teachir^ Research is rio^» 
reasonably dear that cdll^e studehts 
are generally reliable and uhbjased 
judges who imd to give the hi^e;t 
ratings to those from whom li'tey 
leim the most (Gaff and Wilson, 
i971; Gentry 1977; Cohen, 1^2; 
Gleasori, 3^). No reieardi of evalu- 
atidri prii^t?ct cw* £ScUll\^de^'elc^merit 
prc^nun could povsibh' hire da^vs- 
liKMti dhciervers with sixie^ y^irs of 
rajsaiSice dfeCTvihg t^hm ^y in 
Sd ctaiootiKi^xKi da>5iandon bad 
with stJch a good opportunity to 



a 



to teprove £fce 
sarify si^its in the 



er|c 



judge the im^ci 6F t^difig on . . 
learning. Tfiatmake ij sad chat we 
don't use students to help teadiers as 
well as to ev^iiate iheiti. and doubly 
sad that we ddht train students lb be 
careful observers of their own 
learning. 

Deigning student iSeedteck/orms 
ihatiie coUeded by the dassroom 
teacher mid^siy through 3ie semester 
rather than at the end and that offer 
construaiye reactions to teaching 
would help students be b«ier con- 
sumers of education as well as help 
teachers be better providers of it _ 
Ultirriatei^', of course^ alLof our Jnfor- 
maiion sfiout midait learning comes 
from students, in the form of out- 
come measures, or v^ue added, or 
self reports on reactions to teadiing. 

Qassrcom ri^eafch is primarily 
aimed at individual teachers for class- 
robrri use, but it would also seem to 



be an id^ way to en^ge depart- 
mental Acuity di- teadiers of multipie 
»2aidns in discussions of ti^chihg 
goals aixl the assessment of 
accbmplishmehts. 

We h<aed, of course, tb r^r^iiiac 
that 5ome measures of student learn- 
ing are quite difficult to construa 
Some people have spent entire 
careers trying to measure creativity of 
critical thinking of ethucal behayibf . It 
Ls true that we know the least about 
measuring the thin^ that aremd^ 
important lo tis as edu(^tbrs. I don't 
thmk that jneans dm we wait timil 
fie "experts" have devised the sq^pro- 
priate mt^ures. Most coji<^e teadi- 
ers are bright, cfeaiiw pecple, with 
high motivaiipri fof dewing mean 
sures of student learning ouicbm«. 
Moreover, there is incr^teg evi- 
dence ihat academic sldlls are b^ 
audied in the context of subject mat- 
ter content. 

We need the full (^rticipation of 
classfdorti tochers in this fefbfm 
mbvemdTit Our riatiohJil gMj to : 
irnprove the quaUty of uhdei^graduate 
educatidn neo^sarily starts in the 
classroom. Most of the r^effcS on 



cb|l<^e student buicdrtles that is high- 
lighted in JhwU^emmi m L&^iuf^ 
and other reforrri r^Jbris consists of 
interpreting-res^cfi oa<X)Hege stu- 
dent that has been conduaed over 
the past twentj' y^ms. It is h^vily 
weighted to^v^d fuil-iime ^dents of 
txaditidpl college age. 

As valuable as that research is in 
dernohstratiiig the irnporianoe of cre- 
ating carhpus envirdrunen^ that are 
su^xjrtive of and^nduch^ to learn- 
ing, dntmadc incras& in the com- 
mutirrg and {^-time mident 
population has^dianged the college 
mvifdfgnent. Campuses, are rnpne 
cbriipreherisive and impersdhal, and 
bn-carnpus extracurncular activiii^ 
aiejrqDlacSLby part-tirne jobs, ganlly 
nesponsibilities, and day-to-day strug- 
^es to survive 

As this trend coniinu*^, what stu- 
daits learn in college will be rtlbfe 
arid more dependeriLbh what they 
learri in classrbbrns. The teachers and 
students iri those classrooms carry the 
hcavi^ Jbtirden Sk^ have_ever or- 
rialfqr the jquali^£>f education: It is, 
indeed, time to take classroom teach- 
ing seriously. ■ 
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